DOCDHEHT RESDH-E 



ED 114 «16 

AUTHOP 



PDB' DATE 
NOTE * 

BDHS PHICE , 
DESCPIPTOFS 



IDENTIEJE^^S 



A5STPACT 



TH 004 90^ 



Ashmdre T^ill ^ 

A Defecriptioit of the ImplVmentation "^of Individually 
G.uifled Educatioh -in Thirty -Wisconsin School^ ' 

' Districts .V ■ ^ ' 

Aug 75 ' ^ ' ' . e 

• 9d. 

■MF'$0.76' flc--$1. 58 Plus Postage 
Adainis^ator .Attitudes; *Evaluation; Formative 
Evaluation; *Indi vidualized Programs; Predictor 
Variatles;. ^Program Development; School Disti*icts; " 
♦Statistical Analysis; Surveys;^ Teacher Attitudes 
IGF- Implementatio.n 'surVey ; *Ind'ividua lly Guided 
Education ; -Wisconsin 



, \ This study attempts to .exam.ine and document the 
implementation pattern of Individually Guided Education (IGE)' across 
"^30 ^i^cor.sin school districts operating ^GE^ progr^ams in their 
schools. Using these results^ -the data 'were^ tlien analyzed .to - " 
d<^t|rmine whrch of the seven IG 3^. components examLned, clontributed 
most^/.'to a favorable oy^rall '^or *Total ZQE Implementation ScoffeV The 
s/sven component's are: organizational arrangement, instructional^ 
programming, materials, measurement ' and evaluation, home school ; . 
relatd'ons, f $fciiitatiye env^ironments, andytes^arah and developmentT* 
The .results ihdicatpd tJiat the pattern of^IGE iip^plementajbion across ' 
^he districts par^irl^ipating in the study ,is^ generally adequate or^ 
approximately .50^pereent along ^e way t;o ^ ^cleal impl^meotation ' of 
the IGE system/ OTily two. of th-e iQt Comppjients, H-ome School Relations 
'■('j5 percent implementation) and Research . and Development ("33 perc-ent 
implementation) were areas where improvement and modification can be 
justified^ now . The remaining ana*lyses, which consisted of. 
corr,elatibnal«^techniques, suggested that districts having a generally 
favorable Total IG'E Tmple ment.ation Score received favorable ratings 
on. the implementation of the MOS-E Organization, Instructional ^ 
f rogramm^g, and the' Measurement, and Evaluation Com^ponents, At this 
point in tijne it appears that Hoae School 'Relations, Materials, and. 
Research. and Development Components are less a part of' the 
im^>lfement ation scene of IGE* (Authd'r/DEP) 
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During the 1974-75 school year, the B.ureau of Planning and Evaluation^ of 
the Wisconsin Department of Public Instruction conducted an implementation 
evaluation of. a Id^cal^school district Individually Guided * Education* (ICE) 
program. 1 A by-product of this Evaluation was the development of the IGE 
Implementation Surrvey , a systematic self-rating device which was designed 
to asse^ and document the implementat^ion status of an operating IGE program 
within and across the seven IGE Component^, of MUS-E Organizational Arrange- 
ment, Instructional Programming, .Materials.i Measur^^nt and Evaluation, Home 
School Relations,^ ^Fdi^ili tat ive Environments and Research and Development.^ • 

Rating devices such as this survey have become a popular and practical 
means- of collecting JLnformafion within the context of evaluation studies". To 
date however, much of. the research Jiteratiire on rktinfes and ^studies dealing 
witii rating ips.truments coh^s fr5m th^ area of ^student ratings of teacher 
Effectiveness in the public 'sehools arid universities* - Typically tftese ratings 
were used as a measure to improve instruction. One of the major problems 
associated with such ratings' is that the items upon which teacher effective- ^ 
ness is rated are often to6 general or *'high :(.nference" in nature, as opposed 
to items of '"low inference" which are specific, and relatively objective. ^ 
It follows thifen that high inference items do not lend . ttiemselves easily to 
33akirtg improvements in instruction, whereas low inference items can facili- 
.tate improvement as they mirror defined teacher behaviors. 

G€hex:alizing then from the studies op strident ratings of teacher effective- 
ness to ratings of program implementation by professionals involved in a. pro- 
gram like IGE, one can hypothesize that the results Jto low inference items 
tailored to specific yro^gram characteristics can be used to impi;ove or at least 
to point out areas of program opera'tion where improvement or modification is 
warranted . ^ , > " 

Using tha IGE Implementation Survey ^ this s^udy aPttempted to: 

a) determine the implementation status of selected JGET programs in. the state 
of Wisconsin; . * • , * • 

b) correlate the low inference-based IGE Coifipon^nt Scores with the cum^ilative 
survey ratings called Total Implementation of ipE;. and 

c) identify the individual IGE Component Score;3 f^hich were good predictors of 
Total IGE linplementation. ' ' - . 
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METHOD - , • • 

t \ 

The Iristrument - 

• ... . • ' • > 

The *IG£ Implementation Survey which consist^ of seventyrone (7l5 process 
objettiv^ statements about IGE -was used\ T}ie survey is designed tp collect 
_teachers\ and other professionals'- ratings of the degree tio whi-ch an*IGE pro- 
gram in operation represents the IGE model. It yields implementation scores 
on each of the seyen IGE Components and a cumulative Totals implementation 
Score. ' r ' 

' ' ' • ' ' / 

-r ' The number of process objective statements associated' with each IGE 
Component on the survey is as follows: MUS-E Organizational Arrangements 
(17 items); Instructional Programming (11 items); Materials (7,item5); 
Measur^ement and Evaluation (15' items); Home School Reiatljbns (8 items); 
Facllitative Environment^ (10 items); and Research and 'Development (3 items).* 
The Total Implement^ion .Score of the IGE system then is/based on the 71 
items across the system. For purposes of this study, th^ IGE Component 
Scores and the Total Iqiplementation Score were anal3r^ed. ' , 

The Data ' ' . . / • 



ERLC 



The, data for this study consisted of- the results obtained on the IGE 
Implementation Survey for thirty (30) WisiipnsjLn school Jdis^rictS .who vplun.- ' 
teered to participate in the study. Tlid survey was administered during 
May, 1975 arid was completejd' by 741 teachef^ admin is ttaiive and some p-ara- 
professional personnel across the 30 districts. ^The survey requires each 
person Co respond to each process objective statement to indicate the extent 
to which the particular statement is implemented in their IGE program. A 
four point response continuum (0 « no implementation tjo 4 => ideal implementa- 



tion) was used to gather the data. Each potential res 
defined so that the answers would be more focused. 



pons.e wab operationally 



The Limitations 



Several limitations in this study need to be poinjt 
which participated in the study differed, on several 
were: duration of IGE operation, subject matter focus 

of individuals .responding.* In addition, though the , 

for this self-completed sui^^y suggested group administ 
appeared *that some districts used individualized 



formats 



ed out. ^The districts 
va|riables, among these 

and number and type 
adimlnistration guidelines 
ration formats, it 



Also, an importafiC llm^-tation is that' in U3ing tfi(i Total Implementation 
Score as a criterion va(tiable, one actually inflates the correlation index 
between the predictor (each, IGE Component Score) and tlie criterion variable 
(Total IGE Implementation) since the Total IGE Implemerltation Score is a 
cumulative index and therefore no.t the result of independent ratings per se, 

Statistical Analysis 

Two types of analyses were Applied to the data. First, mean scores (Aver 
age Percent of Implementation), ranks, and standard deviations were calculated 
for each IGE Component and th^ Total Implementation Score, 



, secondly, to detennioe the contribution of each component score to the . ' 
variation of the Total Implementatiori Score two correlational techniques were 
used: a) mean ratings on IGE Component Scores one through' seven vere correlated 
with the Total Implementation Score* The components which cqrrelated highly 
^with the Total Implementation Score were assumed to laeke strong contributions to 
overall IGE itnplementation; and b) partial correlation coefficients were cal- ' 
culated between each of the IGE Component Scores and the Total Implementation 
Score to examine the ^relationship between each -component score to thfe Total IGE* 
Implementation Score when the effects of the other .components are statistically 
controlled. The components which have high partial correlations are those that 
make strong independent contributions to variation in overall IGE implementation 
and consequently are* considered important IGE characteristics. 



' RE^SULTS 

The firsrt analysis con^isted'of computing mean .scores or an aver4ge per- 
. cent of implementation for each of the seven . components and the total score. 
These are summarized in Table 1, along' with the st>andard deviations and ranks 
associated with each^mean* Examination of the results indicate that Components 
1> 3, 4, and 6 approximate an adequa^te ^level of implementation according to 
the suggested interpretation for each stage of implemenfation. * The Total 
Implementation Score (46%) also represents an adequate stage of implementation. 
The Home School Relations Component (35%) and , the Research and Development 
Component (33%) %re two areas howevei;, where improvement in implementation can 
bje justified. ^ , 

The second analysis consisted of two correlational exercises which are 
presented in Table 2. Pearson-Pro*duct moment correlations were computed be- 
tween the mean scores for components one through seven and. the Total Implemen- 
tation Score. These correlation data show that the IGE characteristics which 
made the strongest cbntr-lbution to Total IGE Implementation were Measurement 
,and Evaluation (.92), MUS-E (.,90), arid Instructional Programming (.90) Thus*, 
it appears that the LGE programs which were perceived as high in overall implfe- 
mentatioji were also rated favtxrably on such characteristics as measurement anld 
evaluation, instructional progranming and MUS-E organizational framework. The 
IGE Components which contributed least ,Co overall implementation were Research 
and Development, Hotne School Relations and Materials. 

The next phase of the correlational analysis consisted of multiple re- 
gression analysis* and the calculation of the partial correlations for each 
component. IGE Components 1-7 were used £|s * the- predictor va-riables with 
the Total Implementation Score the criterion variable. The partial correlations 
for each of the predictor variables with the linear effects hi every other pre- 
dictor variable partialled out are also shown in Table 2. This partial corre- 
lation ajialysis allows us to focus on the independent contribution of each IGE " 
Component to t\)e overall IGE implementation pattern. 

. In examining the partial correlations, we can observe a slight reordering 
of the predictor variables (Components 1-7) in terms of their contribution 
to total implementation. Based on the IGE Components which showed a strong 
independent relatioi>ship to total IGE implementation, the generally well- 



- 4 - 



inplemented IGE program was also perceived favorably in the implementation of 
the MUS-E Organizational Arrangements, Instructional Programming and Measurement 
and Evaluation Components. 

.V/hen.used together,. IGE Components 1-7 accounted for 98 percent of the 
variation of total implementation, with the. multiple correlation coefficient ' 
between the weighted sum of the predictors and the criterion variable at .99. 
Tnese data suggest. that the domain of ratings of IGE implementation was covered 
rather completely by the analysis. 
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TABLE 1 


4 

t 


] 


Descriptive Statistics Across the Thirty I'GE Projects Which Completed the 
IGE Itnplementation Survey During the Spring,^ 1975. 




N =» 741 , 






IGE 
COMPONENT 


AVERAGE 
^ PERCENT OF 
IMPLEMENTATIOlf* 


S.D. 


- RANK 
' OF « 
■ IMPLEMENTATION 


!• MUS-E Organizational 
-f Arrangements ^ 


\.45 ^ ' 


' 18. 8' 


^ 4 • • ■ ' 


2. Instructional Programming 


50 


20.6 


2.5 


3. Materials 


54 


21.2 


1 


4. Measurement and- Evaluation 


50 


2i.8 


2.5 


5. Home School Rela^tions 


35 


18.9 


6 


6. Facilitative Environments 


43 


21.5 


5 


7. Reseai^ch and* Development 


33 


24.5 


7 


TOTAL Implementation 

. :^ : 


46 


17.8 


1 



* Interpretation 



, 0% = no "implementation 
25% =» some implementation 
50%, = adequate implementation 
75% = approaching idead implementation 

100% = ideal implementation . 
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TABLE 2 



The Pearson Correlations, Partial Correlations and Ranks Relating IGE 
Component One Through Component Seven to the Total Impleaientation. Score 
jpm the IGE Implementation Survey Administered to Thirty Wisconsin • 
districts Using IGE, Spring 1975\ / ^xn 



— ■ PEARSON r WITH 

TOTAL Implementation 



PART-IAL CORRELATION* 
WITH TOTAL II^PLEMENTATIOI^ 
CONTROLLING ALL OTHER COMPONENTS 



COMPONENT (Predictor Variable) r 



rank 



rank 



1. 'MUS-E Or^ganizational 





Arrangements . 


• 90 


2.5' 


.78 




1 


2. 


Inst rue tioncd Programming 


* 

.90 


2.5 


.56 




2 


3. 


> 

Materials 


.79 


5 


.46 




5.5 


4. 


Measurement and Evaluation 


.92 


1 


.55 




3 


5. 


Home School. Relations 


.75 


6 


.46 • 


*■ 


5.'5' 


6. 


Facilitative Environments 


. -85 


4 ■ 


.54 




- 4 


7. 


Research h Development 


_/70, 


7 


.24 




7 



TOTAL Implementation (Criterion Variable) " 



*fh 



e partial correlation (rp) for each component represents the correlation " 
oetween each component and' the Total Implementation Score when the effects of 
the other components are statistically controlled. 
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CONCLUSIONS 



This study .attempted to examine arid document the implementation pattern 
of IGE across thirty Wisconsin school ^districts operating IGE programs in their 
schools. Using these results, the data were then analyzed to determine which 
of the seven IGE Components examined, contributed most to a'favorable overall 
or Total IGE Implementation Score. 

The results indicated that the pattern of IGE- implementation across the i 
districts participating in the study is generally adequate or approximately 
50 percent along the way to an ideal implementation of the IGE system. Only 
two of the IGE Components, Home School Relations (35 percent implementation) 
and Research and Development (33 percent implementation) were areas where 
improvement and modification can be justified now. 

. The remaining analyses, which consisted of correlational techniques, sug- 
gested that districts having a generally favorable Total IGE Implementation 

Score received favorable ratings on the implementation of ythe I-fUS-E Organization, 
Instructional Programming; and the Measureroeht and Evaluation Components. At 
this point in time' it appears -that Home School Relations, Materials, and Research 
and Development Components are less a part of the implementation scene' of IGE. 



IMPLICATIONS 

^ The present study did not set out to test a set of a priori hypotheses but* 
to identify and explore the nature of IGE implementation in a selected sample 
of schools in Wisconsin. Perhaps the most. saLient question to be dealt with in ' 
future research on IGE implementation might focus on the relationship between 
degree of implementation and program effect(s) , using implementation as one of 
the independent variables. It would be -useful to know, for example, if variation 
in implementation in one or more of *the IGE Components produces a^ariation in 
possible program effects^, such as achievement, cost , ^ student attitude, teacher 
morale, administrator role performance, etc. Information relating certain in-' 
puts (implementation) to probable effects would certainly be helpful in deter- 
mining where the greatest payoff among competing program development costs and 
alternatives may be. 

The study also raises question^ of a more immediate nature which apply to 
tfte 30 districts from which data were obtained arrd to other, distric ts which have 
recently inaugurated IGE ag the primary instructional mode* Are they evaluat- 
ing their IGE program? If so, how are they evaluating their program? Are they 
evaluating the outcome variables using summative evaluation designs such as pre- 
and post-testing, or are they^ using formative evaluations to facilitate the full 
.development of the IGE programs? 

There have been some concerns raised in the literature which describes the' 
pitfalls associated with the use of ,summative or outcome evaluation procedures 
alone in evaluating innovations like IGE.^ It might be best for these schools 
to focus^ their evaluation strategies, first to areas of program operation to 
ensure that the program in action meets some predetermined criteria, and then, 
having some certainty that the program exists according to expectations, employ 
summative evaluation to assess the degree to which the program met its outcome 
objectives. 
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